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Figure 3: Rate and distortion for sequence CHILDREN coded with independent con- 
trol at 128 kbit/s. 



4.2 Overall Quality Optimization 

The parameter sets which have been selected according to the before mentioned preferences 
are presented in the following tables: 
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In the sense that higher weights for the distortion induce the algorithm to choose lower 
quantization parameters (=> better quality) and vice versa. The results for this tests are: 
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In comparison to the average results of the independent control, we gain 2-6 dB for News 
while the quality for Children decreases (because the independent control exceeds the tar- 
get bit rate). This is almost the same for the second parameter set. Taking into account that 
these results (set 2) are obtained simulating a case which could be real, the effects are sig- 
nificant, although more visible for higher bit rates. Comparing them with set 1 for sequence 
News, the PSNR of the most important object (VO 2) increases (0.3 dB for 128 and 256 
kb/s) due to the (relative) higher parameter, while the values of the others in general de- 
crease. The quality of VO 1 should also increase a little because its weight is relatively 
high, but below 256 kb/s this is not achieved because it requires a high bit amount (moving 
TV screen). 

For V03, a lower quality is only achieved for 64 kb/s due to the fact that it is a still object 
which can be coded perfectly already with a very small bit amount. Also, as it is the last 
coded object, its bit budget consists of the rest of bits which remains after coding of the 
other objects and can differ significantly. This can be observed in the fluctuating PSNR 
curve for VO 3 in figures 2 a) and b), which show the results for 128k. As it is the static 
logo, it could be coded with constant quality at a low rate (see figure 2, independent con- 
trol). There are also some effects which are not visible in the table of average PSNR values, 
e.g. the PSNR of VO 1 is higher in the first half and lets space which unfortunately is not 
usedbyVO2butVO0. 

For the sequence Children the effects are visible more clearly, i.e. the average PSNRs are 
adapting better to the weights. The PSNRs of objects with lower weights are lower and the 
one of VO 1, which keeps the weight one, is higher, even more with a higher target rate. 
Comparing figures 2 a) and b), it can be observed how the distortion curve of VO .1 in- 
creases in the second half of the sequence over the one of VO 0. 



11 



— VOPQ.0 , Sir 
VOPl.O % 




b) 
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Figure 3: Global optimization for the sequence CHILDREN tested at 128kb/s. Above: 
parameter set 1, below: parameter set 2. 
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4.3 Priority List 



As described in section 2.2 for this algorithm an objective list has to be provided. To simu- 
late the formerly mentioned conditions, this list has been set as follows: 

{(2, d target) > (1> d target) > (0, d target) y (3, d tar g et )} 

which also specifies the second list of hierarchies as it is realized in the current implementa- 
tion. 
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Results: 
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0 




35.47 
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23.7 
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28.34 



The here obtained average PSNRs are not so high as the former ones, but they still outper- 
form the ones of the independent control 

The table shows that this algorithm is more useful than the former one if a strictly hierar- 
chical coding is desired. VO 1 and VO 2 in News and Children e.g., are now coded in the 
desired order. As before with the minimization algorithm, the least important object does 
not release many bits, due to the small bit amount it needs, and, as in the case of Children, 
due to the order of coding. As the least important VOP is coded first, its quantization pa- 
rameter is chosen with respect to the estimated bit rates of the other objects, which can not 
be so exact, because the mads are not known, i.e. this example shows clearly how the se- 
quential implementation reduces the flexibility of the algorithms. 
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Nevertheless, figure 4 a) shows how good the desired order of objects 1 and 2 is fulfilled 
for sequence News. Unless the resulting average PSNR values are quite good, the algorithm 
forces too much the g ood quality ( and the achievement of the target PSNR) for the most 
important object, artran-taNH^^ aBdd*ag^*^Hp»ed (the buffer control auto- 

matically regulates the target rate) which leads to very unstable results. In figure 4 b), the 
curves show that for the sequence Children the desired order is nearly obtained. VO 1 is 
coded with best quality and higher than VO 2 and VO 0. The curve of VO 2 achieves in the 
second half to be situated above the one of VO 0, which, as it represents the background, 
does not loose much quality because it is already coded with very few bits. The desired tar- 
get PSNR of 35.0 dB almost could be reached due to the available bit rate. 
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Figure 4: Priority based optimization for the sequences NEWS (above) and 
CHILDREN (below) tested at 128kb/s and 256kb/s respectively. 
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4.4 Constant Ratios 



The parameter set for the ratio values according to the former hierarchy has been obtained 
in the following manner: 



As 
and 



PSNR 2 = frPSMi; 
PSNR = 20\og l0 ^j- 



PSNR 2 =20 log 



( 255- fi 2 ) 



= PSM?,+201og 10 (/? 2 ) 



So we set up possible differences of the PSNRs in relation to the most important object and 
calculated the corresponding # as: 
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These tests also were made with a reference set (/% = 1). The following tables show the cor- 
responding results: 
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As can be seen, the algorithm works very well for the case of equal distribution, the higher 
the target bit rate the better. For 256kbit/s, the obtained distortions are almost equal. The 
results obtained with the second parameter set are not so favourable for lower bit rates, but 
for 256kbit/s the desired ratios are obtained nearly exactly for both sequences. The fact that . 
the desired ratios are not achieved in every case is due to the characteristics of the objects in 
the sequences. I.e. the least important objects are always easier to code with a good quality, 
because in general they does not move, change their shape etc. So, unless one of the other 
objects requires a big bit amount, the quality remains high. To show this, we also present 
the graphic for the quantization parameter in figure 5. 
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Figure 4: Rate and distortion for sequence NEWS coded at 256kbit/s with parameter 
set 1 (above) and parameter set 2 (below). 
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Figure 5: Evolution of quantization parameters for sequence NEWS, left: parameter 
set 1, right: parameter set 2 
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Figure 6: Rate and distortion curves for sequence CHILDREN at 256kbit/s. above: 
parameter set 1, below: parameter set 2. 
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5 Conclusions 

In this report we have presented three new multi-object based bit allocation criteria and 
corresponding algorithms for MPEG-4. They provide an efficient utilization of the target bit 
amount and user interaction because of their capability to guarantee certain conditions on 
the absolute or relative coding qualities of the objects. 

In general, the results are good* as the criteria are fulfilled in most of the cases. The best 
behaviour corresponds to the third presented algorithm which codes the objects regarding to 
certain distortion ratios. The overall minimization algorithm has also a good performance, 
the algorithm based on priority lists still does not fulfil our expectations and will be im- 
proved. 

In general the following difficulties appear: 

• The quantization parameters are too coarse to allow the obtainment of exact ratios, be- 
cause the bits and distortions corresponding to one unit difference can be very high and 
so extremely "discrete". 

• Exact source modelling is difficult for objects which are still and then changing abruptly 
so that the model, due to obtaining similar data during a long period, provides wrong es- 
timation values. 

• Static and minimal changing objects have got a special behaviour. Here it is possible to 
code them qualitatively high with a small bit amount, so that it is nearly impossible to 
reach certain ratios to other objects or to show that the are really coded with lower prior- 
ity. ' 

• The knowledge of the prediction errors of all VOs is very important for correct global 
distribution of the target bit amount but can not be provided by the current structure of 
the VM implementation. 

Summarizing, the proposed work is promising unless there are still some tasks open to 
solve. Interesting directions of improvement are: 

• Combine the here proposed bit-allocation criteria with the macroblock-level bit- 
allocation techniques proposed in MPEG-4 [3]. 

• Incorporate some features of other models proposed in MPEG-4 [3] 

Besides, the behaviour of the algorithms with other rate control algorithms (i.e., procedures 
to provide the total number of bits for all the VOPs) has to be studied. 
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